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(57) Abstract 



The present invention provides a method of active queue management for handling prioritised traffic in a packet transmission system. 
The method is able to provide differentiation between traffic originating from rate adaptive applications that respond to packet loss. Traffic 
is assigned one, of at least a first and second, drop precedent level, namely in profile and out of profile. The method includes the steps 
of: calculating an average queue length, avgjql; assigning minimum thresholds, min_th_in and min_th_out, for in profile packets and out 
of profile packets respectively, and a maximum threshold, max-th; retaining all packets with their initially assigned drop precedent levels 
while the average queue length is less than, or equal to, a threshold th_in; assigning a drop probability to each packet, determined from 
the average queue length; retaining all packets while avgjql is less than th_in; and dropping packets in accordance with their assigned drop 
probability, the parameter max_p_out is greater than max-pJn, where max_p_out is the maximum drop probablity of packets marked as out 
of profile and max-p_in is the maximum drop probability for packets marked as in profile. 
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METHOD, SYSTEM AND ROUTER PROVIDING ACTIVE QUEUE MANAGEMENT IN PACKET TRANSMISSION 
SYSTEMS 

The present invention relates to methods of active~queue management in 
packet transmission systems, especially internet systems, telecommunications 
systems employing such methods and routers employing such methods. 

The current Internet architecture offers one service only, namely, best-effort. 
The Internet community has recognized the importance of simplicity in the 
forwarding mechanisms, but has also recognized that this single service may not 
be enough to support the wide range of applications on the Internet. The Internet 
Engineering Task Force (IETF) is, therefore, designing architectural extensions to 
enable service differentiation on the Internet. The Differentiated Services (DiffServ) 
architecture, see: 

Black D. et. al. (1998), An Architecture for Differentiated Services, 
IETF RFC 2475, December 1998; 

Bernet Y. et. al. (1998), A Framework for Differentiated Services, 
IETF DRAFT, October 1998; and 

Nichols K. et. al. (1998), Definition of the Differentiated Services 
Field (DS Field) in the IPv4 and 1Fv6 Headers, IETF RFC 2474, 
December 1998; 

includes mechanisms for differentiated forwarding. 

One proposed mechanism for DiffServ is to assign levels of drop 
precedence to IP packets. This mechanism is included in the Assured Forwarding 
(AF) per-hop behavior (PHB) group, see: 

Hainanen J. et. al. (1998), Assured Forwarding PHB Group, IETF 
DRAFT, November 1998. 



AF can be used to offer differentiation among rate adaptive applications that 
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respond to packet loss, e.g.. applications using TCP. The traffic of each user is 
tagged as being in. or out of. their service profiles. Packets tagged as in profile are 
ass.gned a lower drop precedence than those tagged as out of profile. In addition 
a packet within a user's profile can be tagged with one. out of several leve.s of 
drop precedence. For now. there are three levels of drop precedence for the AF 
PHB group. 

**•. 

Multiple levels of drop precedence can be created with an active queue 
management (AQM) mechanism applied to a FIFO queue. An advantageous 
property of FIFO queues is that packets are forwarded in the same order as they 
arnve. Thus, packet reordering, which can reduce the performance of a TCP 
connection, is avoided. Moreover. FIFO queues are suitable for high-speed .inks 
since they can be implemented efficiently. 

Two known AQM mechanisms are RIO. see: 

Clark D. and Fang W. (1997). Explicit Allocation of Best Effort 
Delivery Service. 1997. URL: 
http://www.diffserv.lcs.mit.edu/Papers/exp-alloc-ddc-wf.pdf, 



and WRED. see: 



Technical Specification from Cisco (1 998), Distributed Weighted 
Random Early Detection, 1998, URL: 

http://www.cisco.comlunivercd/cc/td/doc/productl/oftware/ios/1 1 1/ 
cc111/wred.pdf; 

Normally, prioritized traffic entering a network is controlled to avoid 
overload. When such traffic is properly controlled. RIO and WRED are found to 
offer an absolute quantifiable differentiation. However, these mechanisms can 
cause starvation of less prioritized traffic if this control fails. That is. traffic tagged 

r^on'" 9 hi9heS ' Pri °"" 2ed l6Vel °' dr ° P PreCeden ° e may suWer "° m 

Failures in traffic contro! will occur due to inaccuracies in admission control 
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d Z 2 V CCeP ' " affiC CaUSi " 9 3 ,emPOra,y ° Ver,0ad ""'» ' hiS — «« < 
dete ted. Moreover, the contro, system, or the signatling protocol, may ,ai, in 

adap ,ng fast enough to changes in network routing topology. Traffic conditioners 

iZ Tol 7 T ^ reC ° n,i9Ured be ' 0re ~ — Th - ■ " P^ra 
if the AQM mechan,sm used can prevent starvation at any toad. 

RIO can be configured to prevent starvation, but a strict hierarchy amono 
Precedence levels cannot be guaranteed under periods ofoverload. The, sTa, 
agged w,,h ,he highest priority ,eve, of drop precedence may experto " a 
arger drop rate than traffic tagged with a ,esser prioritized lie, SuT a 

y "™ O, , R ' O ' t S '' here,0re - nO,adV ' Sabte A — ^-chanismshou, no 
on,y prevent starvation, i, shou,d also preserve a strict hierarchy amono 

precedence levels at any load. 9 

A queuing mechanism creating multiple levels of drop precedence can be 
ordered to be load-folerant if . can meet the following JL»JL?* 

prevent starvation of tow prioritized traffic - that is. low prioritized 
traffic must always get a useful share of the bandwidth available 
and 

preserve a strict hierarchy among precedence levels - that is traffic 
"Sing a certain precedence level must always experience lass 
probability of loss than fraffic using a less prioritized level of drop 
precedence. 

onerarr^rT' 689 ^ 

the same RTT xZ " " SS priorifee * «P flow with 

another AnaLJ. l!!' 9Uaran ' eeS " '° ° ne ,low ' «*■ to 

flow an Z^Z^LTT ™ S ^ °' d ' fferen " a ' i0n ™ ^ 3 TCP 
quantified throughput independent of the throughput other TCP 
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It can be assumed that absolute differentiate services are more desireable 
for many users than relative services, since they are more predictable. With an 
absolute service, the quality of a certain communication session is known in 
advance. This pre-knowledge is, for example, valuable when choosing the optimal 
level of redundancy coding. With a relative service, the level of coding has to be 
chosen based on heuristics, or real-time measurements. 

Neither RIO, nor WRED, can meet the requirements for load-tolerance 
stated above, while providing an absolute differentiation. The present invention, 
however, provides a newqueuing mechanism, WRED with Thresholds (WRT) The 
benefit of the present invention, i.e. WRT, is that, without reconfiguration it 
prov.des an absolute differentiation, if prioritized traffic is properly controlled and 
a relative differentiation in other cases. Thus. WRT can be considered load- 
tolerant according to the definition stated above. 

The load-tolerance of WRT can be examined by means of simulations The 
s.mulat.ons are focused on the qualitative behavior of WRT under different grades 
of overload, rather than its quantitative behavior at a specific load. Simulations 
comparing WRT with RIO and WRED show that WRT offers equal differentiation 
to these mechanisms. Thus, other simulation studies of RIO and WRED. providing 
quantitative results, are likely to be applicable to WRT. 

For constructing end-to-end services, load-tolerance is advantageous for 
several reasons. First, traffic control does not need to be so accurate and/or a 
larger portion of prioritized traffic can be allowed in a network. Moreover, failure in 
controlling this prioritized traffic cannot cause any starvation. 

It is an object of the present invention to provide a queuing mechanism 
creatmg multiple leve.s of drop precedence which can prevent starvation of low 
pnoritized traffic. 

It « a further object of the present invention to provide a queuing 
mechanism creating multiple levels of drop precedence which can preserve a strict 
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hierarchy among precedence levels - that is. traffic using a certain precedence level 
must always experience less probability of loss than traffic using a less prioritized 
level of drop precedence. 

According to a first aspect of the present invention, there is provided a 
method of active queue management, for handling prioritised traffic in a packet 
transmission system, adapted to provided differentiation between traffic originating 
from rate adaptive applications that respond to packet loss, in which traffic is 
assigned one. of at least two. drop precedent levels, characterised by preventing 
starvation of low prioritised traffic while, at the same time, preserving a strict 
hierarchy among precedence levels, and providing absolute differentiation of traffic. 

According to a second aspect of the present invention, there is provided a 
method of active queue management for handling prioritised traffic in a packet 
transmission system, adapted to provided differentiation between traffic originating 
from rate adaptive applications that respond to packet loss, in which traffic is 
assigned one, of a plurality of drop precedence levels, characterised by using a 
modified RIO, ItRIO. combined with WRED. so that a plurality of threshold levels, 
for average queue length, are created, by applying different drop probabilities to 
each precedence level and by setting all maximum threshold levels to the same 
value. 



Absolute differentiation may be provided if prioritised traffic is fully controlled 
and relative differentiation may be provided in other cases. 

At least two drop precedence levels may be provided, in profile and out of 
profile.a packet, tagged as in profile may be reclassified as out of profile, when a 
drop probability assigned to the packet is greater than a drop probability calculated 
from the average queue length for in profile packets, and a packet tagged as out 
of profile may be discarded when a drop probability assigned to the packet is 
greater than a drop probability calculated from the average queue length for out of 
profile packets. 

A maximum threshold value for the average queue length for out of profile 
packets. max_th_out, and a maximum threshold value for the average queue 
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length for in profile packets, max_th_in, may be provided and max_th_out may be 
set to a greater value than max_th_in. 

A set of threshold parameters, max_th_in. min_th_in and maxjD_in, may 
be used instead of RED parameters, to determine whether an in profile packet 
should be tagged as out of profile. 

Said plurality of threshold values, max_th#, may be set to the same value. 

Three levels of drop precedence may be provided, and an average queue 
length for each level of drop precedence may be calculated based on packets 
tagged with that level, and packets tagged with a higher level, of drop precedence. 

A unique threshold may be assigned to each of the two highest prioritised 
precedence levels, said unique thresholds being used to determine when a packet 
is to be tagged with a lower precedence level, and a relative differentiation among 
said three levels may provided when the average queue lengths for the two highest 
precedence levels exceeds both thresholds. 



More than three drop precedence levels may be provided and an average 
queue length parameter may be employed for each drop precedence level with 
associated thresholds min_th#s and max_p#s. 

Eight drop precedence levels may be provided. 

A single minimum threshold, thjn, may be provided for all precedence 
levels such that no packets are dropped if the average queue length is less than 
thjn. 

According to a third aspect of the present invention, there is provided a 
method of active queue management for handling prioritised traffic in a packet 
transmission system, adapted to provided differentiation between traffic originating 
from rate adaptive applications that respond to packet loss, in which traffic is 
assigned one, of at least a first and second, drop precedent level, namely in profile 
and out of profile, characterised by: 
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calculating an average queue length, avg_ql; 



assigning minimum thresholds, min_th_in and min_th_out, for in 
profile packets and out of profile packets respectively, and a 
maximum threshold, max_th; 

retaining all packets with their initially assigned drop precedent 
levels while the average queue length is less than, or equal to, a 
threshold thjn; 

assigning a drop probability to each packet, determined from the 
average queue length; 



retaining all packets while avg_ql is less than thjn; and 



dropping packets in accordance with their assigned drop probability; 

and by max_p_out being greater than max _pjn, where max_p_out is the maximum 
drop probability of packets marked as out of profile and max _p_in is the maximum 
drop probability for packets marked as in profile. 

Said method may be applied to a FIFO queue. 

Said method may include the steps of: 

dropping a packet if avg_ql, when the packet arrives, is > maxjh; 

for a packet tagged as in profile, calculating avg_ql_in, and, if 
av 9_qLJn > thjn and minjhjn < avg_ql, calculating Pin and 
dropping, or retaining, said packet in accordance with the value of 
Pin; 



for a packet marked as out of profile, if minJh_out < avg_ql, 
calculating Pout, and dropping, or retaining, said packet in 
accordance with the value of Pout. 
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A plurality of drop precedence levels, greater than two. may be employed 
and an average queue length may be derived for each drop precedence level. 

Said maxjh for each drop precedence level may be set to the same value. 

Three levels of drop precedence may be provided, and an average queue 
length may be calculated for each level of drop precedence based on packets 
tagged with that level and packets tagged with a higher .eve. of drop precedence. 

A unique threshold may be assigned to each of the two highest prioritised 
precedence levels, said unique thresholds being used to determine when a packet 
« to be tagged with a lower precedence level, and a relative differentiation may be 
provded among said three .eve.s when the average queue lengths for the two 
highest precedence levels exceeds both thresholds. 

More than three drop precedence levels may be provided and an average 
queue length parameter may be employed for each drop precedence level with 
associated thresholds min_th#s and max_p#s. 

Eight drop precedence levels may be provided. 

A single minimum threshold, thjn. may be provided for all precedence 
evels such that no packets are dropped if the average queue length is «ess than 
thjn. 

According to a fourth aspect of the present invention, there is provided a 
telecommunications system for transmission of packet data, characterised in that 
sa,d telecommunications system employs a method of active queue management 
as set forth in any preceding paragraph. 

Said telecommunications system may be an internet. 

According to a fifth aspect of the present invention, there is provided a 
router for use with a telecommunications system as set fourth in any preceding 
Paragraph characterised in that said router employs a method of active queue 
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management as set forth in any preceding paragraph. 

Embodiments of the invention will now be described, by way of example, 
with reference to the accompanying drawings, in which: 

Figure 1 illustrates the RED mechanism. 

Figure 2 illustrates the WRED mechanism. 

Figure 3 illustrates the RIO mechanism. 

Figure 4 illustrates WRED configured to offer an absolute differentiation. 

Figure 5 illustrates WRED configured to offer a relative differentiation. 

Figure 6 illustrates the WRT mechanism of the present invention. 

Figure 7 lists a pseudo-code for WRT. 

Figure 8 illustrates a simulation arrangement. 

Figure 9 is a table showing bandwidth allocation limits with ItRIO. 

Figure 10 shows the characteristics of RIO and ItRIO 

Figure 11 shows the characteristics of WRED and WRT. 

Figure 12 shows ItRIO under sever overload. 

Figure 13 shows ItRIO under limited overload. 

Figure 14 shows RIO under limited overload 

Figure 15 shows the load tolerance of RIO, ItRIO and WRT. 
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A glossary of the abbreviations used in this patent specification is set out 
below to facilitate an understanding of the present invention: 



AF: Assured Forwarding 

AQM: Active Queue Management 

CS: Class Sector 

DiffServ: Differentiated Services 

EF: Expedited Forwarding 

FIFO: First In First Out 

IETF: Internet Engineering Task Force 

IP: Internet Protocol 

ISP: Internet Service Provider 

ItRIO: Load Tolerant RIO 

PHB: Per Hop Behaviour 

RED: Random Early Detection 

RIO: RED In and Out 

RTT: Round Trip Time 

TCP: Transmission Control Protocol 

TSW: Time Sliding Window 
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User Datagram Protocol 
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WRED: Weighted RED 

WRT: WRED with Thresholds 

The main objective of AQM mechanisms is to reduce thfe average queue 
length in routers. This provides less delay, avoids flows being locked out and, 
optimally, reduces the number of packets dropped in congested routers. In 
addition, AQM can be used to implement service differentiation between different 
flows, e.g., TCP flows. An advantage with AQM is that one single FIFO queue can 
be used for all traffic belonging to these flows. This is advantageous if reordering 
of packets within flows is to be avoided. It should be noted that in FIFO queues, 
packets are forwarded in the same order as they arrive. 

WRED and RIO are two examples of the use of AQM to achieve service 
differentiation. WRED and RIO are both extensions to RED, which is briefly 
described below. 

RED was originally proposed in 1993 by Floyd and Jacobson, see: 

Floyd S. and Jacobson V. (1993), Random Early Detection 
Gateways for Congestion Avoidance, IEEE/ACM Transactions on 
Networking, August 1993; 

and is now recommended for deployment in the Internet, see: 

Braden B. et al (1998), Recommendations on Queue Management 
and Congestion Avoidance in the Internet, IETF RFC 2309, April 
1998. 

RED allows a router to drop packets before any queue becomes saturated. 
Responsible flows will then back off, in good time, resulting in shorter average 
queue sizes. This is desirable for several reasons. The queuing delay will 
decrease, which is good for applications such as interactive games. Another 
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advantageous property of RED is that packet drops will not occur in bursts. This 
decreases the likelihood of TCP flows going into slow-start phase due to multiple 
consecutive lost packets. RED achieves this by dropping packets with a certain 
probability depending on the average queue length (avg_q|). see Figure 1. 

Unfortunately, the optimal configuration for RED depends on traffic patterns 
and characteristics. For example, if there is a large number of TCP flows present 
in a queue, RED needs to be aggressive to achieve its goal, i.e., max_p has to be 
set high. Otherwise the queue is likely to grow towards its limit and it will eventually 
behave as an ordinary tail-drop queue. On the other hand, if only a small number 
of flows are present in a queue, a too aggressive RED can reduce the utilization of 
the link in question. Adaptive RED. see: 

Feng W., Kandlur D.. Saha D. and Shin K. (1997), Techniques for 
Eliminating Packet Loss in Congested TCP/IP Networks, 
Technical Report, University of Michigan, November 1997, URL: 
http://www.eecs.umich.edU/~wuchang/work/CSE-TR-349-97.ps.Z 

is an attempt to solve this configuration problem. However, this mechanism does 
not solve the problem if a large amount of the traffic originates from applications not 
responsive to network congestion, e.g., realtime applications using UDP, or short- 
lived http transfers using TCP. 

WRED, defined and implemented by Cisco, and RIO. proposed and 
evaluated with simulations by Clark and Fang, are two AQM mechanisms defined 
for service differentiation in IP networks. They are both based on RED and offer 
differentiation by managing drop precedence. 

With WRED, eight separate levels of drop precedence can be configured. 
Each of these levels is configured with a separate set of RED parameters - see 
Figure 2. RIO, on the other hand, has only two sets of RED parameters. Hence, 
in its basic version, two levels of drop preference can be created, i.e.. one level for 
packets tagged as in profile and another level for packets tagged as out of profile. 

The main difference between RIO and WRED is that RIO uses two average 
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queue lengths for calculating drop probabilities, while WRED only uses one. 
WRED calculates its average queue length (avg_ql) based on all packets present 
in the queue. RIO does this as well but, in addition, it calculates a separate 
average queue length for packets in the queue tagged as in profile (av_ql_in) - see 
5 Figure 3. 

There is a clear distinction between absolute and relative differentiation 
between levels of drop precedence. In this context, absolute differentiation implies 
that a certain precedence level offers a quantifiable bound on loss. That is, traffic 
using that particular level is guaranteed a maximum loss rate. Thus, a TCP flow 
1 0 can be given an absolute quantified throughput independent of the throughput other 

TCP flows will experience. 

A maximum bound on loss can only be offered to traffic that is properly 
controlled. That is, the rate at which prioritized packets arrive at the network must 
be limited to ensure that the drop rate never exceeds the bound. Consequently, 
15 traffic control is necessary to create absolute differentiation of services. 

A relative differentiation does not offer any quantifiable bounds on loss. 
Instead, the drop rate for each precedence level is defined in relation to some other 
level. For example, one precedence level may offer half the drop rate of another 
level. From these drop rates, defined in relation to each other, a differentiation in 
zO throughput can be achieved between TCP flows. 

When supporting an absolute differentiation for traffic using a particular 
level of drop precedence, traffic using other precedence levels may get starved. 
This problem can occur if traffic using the absolute level is insufficiently controlled. 
That is, the arrival rate for traffic that is to be given an absolute bound on loss 
25 exceeds the rate at which the network can support that bound. 

WRED and RIO can be configured to support an absolute differentiation. 
To create such a differentiation, these settings require proper control of traffic using 
the precedence level supporting absolute differentiation only. That is, traffic using 
other precedence levels need not be controlled. 
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With WRED, absolute differentiation is supported by setting max_th# to 
separate values. Moreover, max_p#s and min_th#s must be set to ensure that 
higher prioritized packets always experience lower loss probability than less 
prioritized packets. An example of such a configuration with two levels of drop 
5 precedence is shown in Figure 4. 

With this kind of configuration, a maximum bound on Icfss is provided if 
av_q| never grows larger than max_th1 , see: 

Braden R. et. al. (1997), Resource Reservation Protocol (RSVP) - 
Version 1 Functional Specification, IETF RFC 2205, September 
10 1998. 

However, to avoid starvation of traffic tagged with precedence level zero 
av.ql must not exceed max.thO. Adequate traffic control is, therefore, needed to 
offer absolute differentiation of services with WRED. 



When using RIO to create an absolute differentiation. max_th_in should be 
set equal to. or larger than, maxjhout. Otherwise, traffic tagged as in profile may 
experience a higher drop rate than traffic tagged as out of profile. This would break 
the strict hierarchy between drop precedence levels. Hence, such a configuration 
is not advisable. 

The configuration of RIO shown in Figure 3 can be used to offer an absolute 
drfferentiation. For example, a maximum bound on loss is offered, if avg q|j n 
never grows larger than max_th_in. However, as with WRED. starvation of lower 
prioritized traffic, i.e. traffic tagged as out of profile, can occur if higher prioritized 
traffic is not properly controlled. With RIO. this control has to ensure that avg q| 
never exceeds max_th_out. 

Neither WRED. nor RIO. can meet the requirements for load-tolerance 
when configured to support absolute differentiation. Prioritized traffic has to be 
properly controlled to avoid starvation of less prioritized traffic and to ensure that 
a stnct h.erarchy is preserved between levels of drop precedence. WRED can 
however, meet these requirements when configured to offer a relative 
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A relative differentiation can be created with WRED if all max_th#s are set 
equal. The differentiation offered depends on the settings of min_th#s and 
max_p#s. These parameters must be set to ensure a strict hierarchy between the 
levels of drop precedence. 

With the setting of WRED, shown in Figure 5. traffic using precedence level 
one will experience half of the drop rate of traffic using precedence level zero. 
However, that relation can only be preserved during modest overload. That is, only 
a small portion of the traffic comes from applications not responsive to network 
congestion, e.g. real-time applications using UDP. or short-lived http transfers using 
TCP. 

When the portion of traffic coming from applications not responsive to 
network congestion gets larger, the overload becomes more severe. If the 
overload gets severe enough, the queue will eventually behave just as a tail-drop 
queue. The exact relative differentiation provided depends on traffic characteristics 
as well as the configuration of WRED. 

RIO cannot be configured to offer a relative differentiation. This is because 
RIO uses a separate variable (av_ql_in) to calculate the probability, Pin, of dropping 
a packet marked as in profile that arrives at the queue. This separate variable does 
not contain any information about the number of packets, in the queue, marked as 
out of profile. The calculation of Pin can, therefore, not be related to the probability 
Pout of dropping the packet if it had been marked as out of profile. 

The present invention comprises a new queuing mechanism that, without 
reconfiguration, provides an absolute differentiation if the prioritized traffic is 
properly controlled and a relative differentiation in other cases. This mechanism, 
Weighted RED with Thresholds (WRT), is constructed by combining RIO with 
WRED. 

The present invention adopts, from RIO, the idea of calculating two 
separate average queue lengths. However, instead of discarding packets marked 
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To achieve a relative differentiation when avg q| in exceeds max th in 
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implemented. The implementation has basically the same complexity as an 
implementation of RIO. 

For the AF PHB group, three levels of drop precedence are specified. To 
create these three levels. WRT has to be extended with support for one additional 
level of drop precedence. This implies that WRT has to be extended with one more 
threshold associated with an additional average queue length! Thus, for each of 
the three levels of drop precedence, a separate average queue length is calculated, 
based on packets tagged with that level and every other packet tagged with any 
higher prioritized level. 



A unique threshold is assigned for each of the two highest prioritized 
precedence levels. These thresholds are used to decide when packets must be 
treated as if they were marked with a lower prioritized precedence level. The 
threshold for the highest level must be set to a lower value than the threshold for 
the second highest level (the order at which the thresholds are set defines the order 
1 5 in Priority between the precedence levels). 

When the average queue lengths for the two highest prioritized levels 
exceeds both thresholds, a relative differentiation is provided among the three 
levels of drop precedence. The relative differentiation depends on howthe min_th# 
and max_p# is configured for each of these levels and the current load of 
x ° irresponsible traffic. 

Whenever needed, WRT can be extended to support more levels of drop 
precedence by adding additional average queue length variables with associated 
thresholds, min_th#s and max_p#s. 



The load-tolerance of ItRIO and WRT can be assessed by using 
simulations. The simulations can be made with a network simulator (ns), see: 

UCB/LBNLA/INT Network Simulator - ns (version 2) (1998). URL: 
http://www-mash.CS.Barkeley.EDU/ns/. 

This allows it to be shown that ItRIO can offer an equal differentiation to that 
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offered by RIO and that WRT can offer the same differentiation as WRED. 

The simulations presented below enable the qualitative behavior of WRT 
under different grades of overload to be examined. Moreover, by comparing WRT 
with RIO and WRED it can be demonstrated that WRT can offer the same 
differentiation as these mechanisms. 

•*. 

To perform the evaluation, a simple simulation setup is used. A topology 

with ten hosts (SO S9) connecting to their respective destinations (RO. .. R9) 

via one common link is used. This link, P1 - 92. is a bottleneck of 30 Mbps with 20 
ms delay, see Figure 8. 

The AQM mechanisms evaluated are applied to the queue attached to the 
bottleneck link. Each host has ten TCP Reno connections with their respective 
dest.nat.ons; The throughput for each of these TCP flows is measured over 16 
emulated seconds. However, every simulation goes through an initiation phase of 
three to four simulated seconds before these measurements are initiated. This is 
to let the queue stabilize before the behavior of the AQM mechanisms to be evalu- 
ate .s observed. The TCP connections are initiated randomly within the first 
simulated second. All these connections have the same RTT (40 ms). 

A time sliding window (TSW) rate estimator is used for each of the ten 
hosts, to tag packets as in profile up to a certain rate. Thus, one service profile is 
apphed for all ten TCP connections at every single host. There are two different 
approaches to tagging packets, based on the rate estimated with the TSW. The 
first approach is more general and can be applied to aggregated TCP traffic as well 
as to individual TCP connections. The second approach should only be applied to 
.nd.v.dual connections but is then more effective if the estimator is placed close to 
the sending host. Since the estimator is applied to an aggregate of ten TCP 
connections the first approach is more appropriate for the simulations herein 
described. 



With the first approach, the window size should be set to a large value i e 
of the order of a TCP saw tooth from 66 to 133 percent of the rate specified in the 
serv.ce profile. Too small a window may cause the aggregate throughput to be less 
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than that specified in the profile. On the other hand, with too large a window, the 
traffic marked as in profile can become more bursty. Hence, the window size may 
affect the throughput experienced by individual TCP flows and the rate variation of 
packets marked as in profile arriving at core routers. Unfortunately, this implies that 
there is a circular dependency between the length in time of a saw tooth and the 
window size. In addition, the length of a saw tooth will vary because packets may 
be randomly dropped in the network. An appropriate window siz& for a certain TCP 
connection is, therefore, hard to choose, based on known parameters only. Thus, 
it may be necessary to adapt the window size based on real time measurement of 
each individual TCP flow. 

For all the simulations, the window size is set to 300 ms. This value is 
chosen on the basis of the following argument. Assume that the target rate of a 
certain TCP connection is set to 500 kbps. The RTT is 80 ms, including the 
average queuing delay and the average packet size is set to 8000 bits in the 
simulations. This TCP connection will then have five packets on the fly, on aver- 
age, and a congestion window of the size of five packets of data, on average. 
Optimally, the number of packets on the fly and the size of the congestion window 
will then vary between 1 .33 * 5 and 0.66 * 5. The variation is thus 0.67 * 5 = 3.35 
packets. Since TCP increases its congestion window with one segment of data, 
equivalent to the payload of one packet, the most for each RTT, the length in time 
of a TCP saw tooth is 3.35 * 0.08 = 0.268s . 

To perform an evaluation of the properties of ItRIO and WRT in comparison 
with RIO and WRED, the average throughput experienced by TCP sources sending 
all their downstream packets marked as in profile is observed, i.e., these sources 
have unlimited rate profiles. This is compared with the average throughput 
experienced by other TCP sources sending all their packets marked as out of 
profile, i.e., sources with zero rate profiles. The number of TCP sources with 
unlimited rate profiles is varied between 10 and 90 percent in steps of 10. The 
results are plotted in graphs with the average throughput as the y-axis and the 
percent of sources with unlimited rate profile as the x-axis. Figure 1 1 shows the 
results for RIO and ItRIO. 



RIO is, in this simulation, configured with max th in and min th in set to 
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1 00 packets, max_th_out to 200 packets, and min_th_out to 1 00 packets. Hence 
the value of max_p_in is not relevant (since maxjh.in and min_th_in are equal)' 
The max_p_out parameter is set to 5 percent. ItRIO has the same configuration 
..e.. the parameters present in both these mechanisms are set to the same values. 
The th_in parameter in ItRIO is set to 100 packets. 

It can be seen in Figure 1 0 that ItRIO offers the same differentiation as RIO 
when the number of flows with unlimited rate profiles is less than 57 percent 
Above that load. ItRIO behaves as RED while RIO no longer preserve the strict 
order of priority between the in and out precedence levels. Thus. ItRIO can support 
absolute differentiation without the risk of giving a lower quality of service to traffic 
marked as in profile than is given to traffic with a lower priority. 

Figure 11 shows the results for WRED and WRT. WRED is. in this 
simulation. Configured with max.thO and maxjhl set to 200 packets minJhO and 
m.njhl to 100 packets max_ P 0 to 5 percent, and max_p1 to 2.5 percent. The 
parameters for the other six precedence levels are not relevant since only level zero 
and one are used (level one is applied to traffic marked as in profile and level zero 
to traffic marked as out of profile). The parameters present in both mechanisms 
are set to the same value. The max_th parameter in WRT is set to 1 00 packets. 

In Figure 1 1 it can be seen that WRT offers a relative differentiation when 
the number of flows with unlimited rate profiles exceeds 50 percent. This 
differentiation is the same as the one offered with WRED. When the number of 
flows with unlimited rate profiles is less than 50 percent. WRT offers the same dif- 
ferentiation as RIO and ItRIO. 

Hence, with this particular configuration. WRT behaves as RIO and ItRIO 
if the number of flows with unlimited rate profiles is less than 50 percent and 
otherw.se as WRED. This means that WRT preserves the strict hierarchy between 
drop precedence levels independent of load. Based on these observations it can 
be concluded that WRT can be used to create an absolute differentiation if the 
pnontized traffic is properly controlled and a relative differentiation otherwise. 

Allowing sources to have unlimited rate profiles represents an extreme 
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situation of overload since the only admission control present is based on the 
number of flows. This can be considered as a worst case scenario when control 
of the aggregated traffic marked as in profile has failed completely. Simulations 
with this kind of overload provide an indication of how sensitive the differentiation 
is to various numbers of TCP sources using unlimited rate profiles. 

To investigate the sensitivity of the differentiation, a common profile of 5 
Mbps is applied to ten percent of all TCP flows, i.e.. all flows from host S9. The 
sources with unlimited rate profiles vary between 0 and 80 percent. Hence, this 
graph goes from 0 to 90 percent of flows with non-zero rate profiles, instead of from 
10 to 90 percent as in the previous graphs. This is to show the throughput that the 
flows from S9 would have had if there was no overload, i.e.. there are no TCP 
sources at all with unlimited rate profiles. ItRIO is used with the same configuration 
as in the simulation presented in Figure 10. 

Figure 12 shows how the average throughput experienced by the ten 
controlled TCP sources degrades with an increasing number of flows using 
unlimited rate profiles. The controlled TCP sources are those with a common rate 
profile of 5 Mbps. It can be seen that a few uncontrolled TCP sources do not cause 
any severe degradation in throughput experienced by the TCP sources sharing the 
5 Mbps profile. This presumes, however, that the flows with unlimited rate profiles 
are responsive to network congestion signalling, i.e.. packet drops. Irresponsible 
applications would cause this degradation to be much more drastic. 

As mentioned above. ItRIO and WRT offer the same differentiation as RIO. 
if avg_qMn never exceeds thjn. The question is then at which load this will 
happen for a specific traffic distribution and configuration of these mechanisms. 
This issue can be studied by performing a set of iterative simulations. Through 
these simulations, the maximum amount of bandwidth that can be allocated without 
causing av_ql_in to grow larger than th_in can be determined. 

Besides varying the target rate in the TSW rate, the same configuration is 
used as in the simulation of ItRIO shown in Figure 10. The table set out in Figure 
9 presents the maximum rates for two different settings of th.in. i.e.. V, and of 
maxjh (the max_th parameter is set to 200 packets). For each of these settings. 
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*™= riOS are simulated, with 30. 40 and 50 percent of a,, flows having „on- 
zero rate profiles. y 

The table set out in Figure 9 shows how bandwidth allocation limit depends 
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By comparing Figures 13 and 14 it can be seen that RIO offers a similar 
differentiation to ItR.O. if the total amount of bandwidth al.ocated is less than 15 
Mbps In addition, these two mechanisms offer a similar differentiation .f the 
number of TCP sources having non-zero rate profiles is 50 percent, or less. 
However, when the number of TCP sources with non-zero rate profiles are 70 
percent and RIO is used. TCP sources with zero rate profi.es.experience more 
throughput, on average, than the ten connections sharing a 5 Mbps rate profile. 
This behavior can also be observed in Figure 10. 

To study the difference between RIO, ItRIO and WRT when the number of 
TCP connections having non-zero rate profiles exceeds 50 percent. WRT .s 
simulated with 70 percent of the connections using non-zero rate profiles. The 
results from this simulation are shown in Figure 15. 

As expected from Figures 10 and 11. only WRT preserves the strict 
hierarchy between the levels of drop precedence. RIO fails completely .n 
preserving this hierarchy and ItR.O behaves as RED when the bandwidth allocated 
exceeds 20 Mbps. Hence. WRT is the only queue mechanism, of these three, that 
can meet the requirements for load-tolerance. 

The simulations, described above, show that WRT. without reconfiguration, 
provides an absolute differentiation, if the prioritized traffic is properly controlled 
and a relative differentiation otherwise. Neither RIO. nor WRED. can provide th.s 
with one single configuration. The absolute differentiation WRT offers is shown to 
be the same as for RIO, when the amount of prioritized traffic is controlled below 

a certain limit and the relative differentiation is shown to be the same as for WRED. 
The bandwidth allocation limit for when the differentiation changes from be.ng 

absolute, to relative, can be roughly estimated based on the configuration of WRT. 

However, the actual bandwidth that can be al.ocated will be less than that 

estimated, if avg_ql_in has a non-negligible variation. 

It should be noted that these results presume that only long lived TCP traffic 
is present in the queue managed by WRT. Greedy UDP traffic and/or short lived 
TCP traffic can affect the behavior of WRT. Any negative affect from such traffic 
can be expected to have a similar affect on RIO and WRED. 
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While constructing absolute quantifiable end-to-end differentiation of 
services based on levels of drop precedence, traffic control must be accurate to 
guarantee that this differentiation is provided at all times. In addition, it may be 
necessary to keep the portion of the traffic using an absolute service small to offer 
such a guarantee. Clearly, if only very little traffic can be given a service like this, 
the overall benefit from absolute services is limited. 

•v. 

However, the load-tolerance of WRT makes absolute services based on 
drop precedences more robust. Starvation cannot occur at any load. Hence the 
network is more robust against failures in traffic control. Due to the robustness of 
WRT, the deployment time for absolute services based on drop precedences is 
likely to be shorter. In addition, more traffic using such absolute services can be 
allowed in the network without risking starvation. 

Another positive effect of the load-tolerance of WRT is that traffic control 
need not be as accurate as with other AQM mechanisms, e.g., WRED, or RIO. A 
less accurate, perhaps measurement-based, control mechanism can ensure that 
an absolute differentiation is offered most of the time. If this control fails, a relative 
differentiation is guaranteed, as a minimum, if WRT is used. 

RIO and WRED support an absolute quantifiable differentiation among 
levels of drop precedence when prioritized traffic is properly controlled. However, 
if this control fails these mechanisms can cause starvation of less prioritized traffic. 
Such failures occur due to inaccuracies in admission control and topology changes . 

Starvation can be avoided with WRED, if it is configured to offer a relative 
d.fferentiation. However, absolute differentiation of services is still necessary. 

To offer an absolute differentiation between precedence levels without 
risking starvation, the present invention provides a new queue mechanism - WRT 
Emulations have shown that WRT, without reconfiguration, provides an absolute 
d.fferent.at,on, if the prioritized traffic is properly controlled and a relative differentia- 
tion otherwise. 

The absolute differentiation WRT offers is shown to be the same as for RIO, 
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when the amount of prioritized traffic is controlled below a certain limit and the 
relative differentiation is shown to be the same as for WRED. Thus, WRT can 
provide whatever differentiation RIO and WRED can offer. Moreover, end-to-end 
services promising an absolute differentiation most of the time and a relative 
differentiation as a minimum can be constructed with WRT. RIO and WRED are 
insufficient for creating such services. 
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CLAIMS 

1 . A method of active queue management, for handling prioritised traffic in a 
packet transmission system, adapted to provided differentiation between traffic 
originating from rate adaptive applications that respond to packet loss, in which 
traffic is assigned one, of at least two, drop precedent levels, characterised by 
preventing starvation of low prioritised traffic while, at the same time, preserving a 
strict hierarchy among precedence levels, and providing absolute differentiation of 
traffic. 

2. A method of active queue management for handling prioritised traffic in a 
packet transmission system, adapted to provided differentiation between traffic 
originating from rate adaptive applications that respond to packet loss, in which 
traffic is assigned one, of a plurality of drop precedence levels, characterised by 
using a modified RIO, ItRIO, combined with WRED, so that a plurality of threshold 
levels, for average queue length, are created, by applying different drop 
probabilities to each precedence level and by setting all maximum threshold levels 
to the same value. 

3. A method, as claimed in either claims 1 , or 2, characterised by providing 
absolute differentiation if prioritised traffic is fully controlled and relative 
differentiation in other cases. 

4. A method, as claimed in any of claims 1 to 3, characterised by at least two 
drop precedence levels, in profile and out of profile, by reclassifying a packet, 
tagged as in profile, as out of profile, when a drop probability assigned to the 
packet is greater than a drop probability calculated from the average queue length 
for in profile packets, and by discarding a packet tagged as out of profile when a 
drop probability assigned to the packet is greater than a drop probability calculated 
from the average queue length for out of profile packets. 

5. A method, as claimed in claim 4, characterised by a maximum threshold 
value for the average queue length for out of profile packets, max_th__out, and a 
maximum threshold value for the average queue length for in profile packets, 
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maxjhjn. and by max_th_out being set to a greater value than maxjhjn. 

6. A method, as claimed in claim 2, or any of claims 3 to 5. when dependent 
on claim 2. characterised by using a set of threshold parameters, maxjhjn. 
minjhjn and max_pjn. instead of RED parameters, to determine whether an in 
profile packet should be tagged as out of profile. 

•v 

7. A method, as claimed in claim 6. characterised by setting said plurality of 
threshold values, maxjh#, to the same value. 

8. A method, as claimed in claim 6, or 7, characterised by three levels of drop 
precedence, and by calculating an average queue length for each level of drop 
precedence based on packets tagged with that level and packets tagged with a 
higher level of drop precedence. 

9. A method, as claimed in claim 8, characterised by assigning a unique 
threshold to each of the two highest prioritised precedence levels, said unique 
thresholds being used to determine when a packet is to be tagged with a lower 
precedence level, and by providing a relative differentiation among said three levels 
when the average queue lengths for the two highest precedence levels exceeds 
both thresholds. 

1 0. A method, as claimed in claim 9, characterised by providing more than three 
drop precedence levels and employing an average queue length parameter for 
each drop precedence level with associated thresholds minjh#s and max_p#s. 

11. A method, as claimed in claim 10, characterised by eight drop precedence 
levels. 



12. A method, as claimed in either claim 10, or 1 1, characterised by a single 
minimum threshold, thjn, for all precedence levels such that no packets are 
dropped if the average queue length is less than thjn. 

1 3. A method of active queue management for handling prioritised traffic in a 
packet transmission system, adapted to provided differentiation between traffic 
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calculating an average queue length. avg_ql; 

assigning minimum thresholds, minjhjn and min th^out for in 
Profile packets and out of profile packets respective*, and a 
maximum threshold, maxjh; 

staining a« packefs with their initial assigned drop preoeden. 
vets wh„ e the averase queue |eng(h |s iess w P n, 

threshold th_in; 1 

assigning a drop probability to eaoh packet, determined from the 
average queue length; 

retaining all paokats while avg_ql is less than th.in; and 
dropping p aokets in accordancs ^ , hejr assjgned drop probabj ^ 

"a FtFoZe"' M daime ° ^ ^ 13 ' CharaCt6riSed by - -thod 



15. 



A method, as claimed in claim 13 . or 14, characterised by: 

dropping a packet if avg_ q l. when the packet arrives, is > maxjn; 

Z\7Tl l L aSBea as in pron,e - calcu,a,in9 -* >< 

7' ^ min - lhJn " «** -W-Ing Pin and 

*opp,ng. or retaining. sa,d packet in accordance with ,he value o, 
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for a packet marked as out of profile, if min_th_out < avg_ql, 
calculating Pout, and dropping, or retaining, said packet in 
accordance with the value of Pout. 

16. A method, as claimed in any of claims 13 to 1 5, characterised by employing 
a plurahty of drop precedence levels, greater than two. and deriving an average 
queue length for each drop precedence level. 

17. A method, as claimed in either claim 15. or 16. characterised by setting 
maxjh for each drop precedence level to the same value. 

18. A method, as claimed in either claim 16. or 1 7. characterised by three levels 
of drop precedence, and by calculating an average queue length for each level of 
drop precedence based on packets tagged with that level and packets tagged with 
a higher level of drop precedence. 

19. A method, as claimed in claim 18. characterised by assigning a unique 
threshold to each of the two highest prioritised precedence levels, said unique 
thresholds being used to determine when a packet is to be tagged with a lower 
precedence level, and by providing a relative differentiation among said three levels 
when the average queue lengths for the two highest precedence levels exceeds 
both thresholds. 

20. A method, as claimed in claim 19. characterised by providing more than 
three drop precedence levels and employing an average queue length parameter 
for each drop precedence level with associated thresholds min_th#s and max_p#s. 

21 . A method, as claimed in claim 20. characterised by eight drop precedence 
levels. 

22. A method, as claimed in either claim 20. or 21 , characterised by a single 
minimum threshold, thjn, for all precedence levels such that no packets are 
dropped if the average queue length is less than thjn. 
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23. A telecommunications system for transmission of packet data, characterised 
.n that sa.d telecommunications system employs a method of active queue 
management as claimed in any of claims 1 to 22. 

24. A telecommunications system as claimed in claim 23," characterised in that 
said telecommunications system is an internet. 

25. A router for use with a telecommunications system, as claimed in either 
cla,m 23. or24, characterised in that said router employs a method of active queue 
management as claimed in any of claims 1 to 12. 
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